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(54) Stereoscopic Image generating apparatus and display therefor 



(57) The stereoscopk: CG image generating appa- 
ratus and a stereoscopic TV apparatus, has a projection 
transformation seclion which/ baised on three-dirnen- 
sloriaLstructu^ information describing a three-dlmen- 
aloriai shape of an object, generates a piuraiity of two- 
dimenfilonal projection models as viewed irom a plural- 
ity of viewpoints, a distance information extraction secr 
tton whteh generates a' cainera-to-objed dls^ 
information used for calculations in the proiectipn trans- 
formation section, and a camm parameter 
section whjchi b^ed oh the output lol the distance infoi^' 
matiori ^inCtoh eiecttoa ^ soreien size of a stereo- 
scopic irnage display, device for displaying fboally' 
generated two-dlrnensional projection n^ and a 
viewers viewing distance, determines camera parame- 
ters so that stereoscopic CQ images will be brought 
wHhin the viewer's binocular fusional range. According 
to the thus oonsfructed etereoecopic CG image generatr 
ing apparatus and stereoscopic TV appairatus, propeir 
camera parameters (focal length or field of view, camera 
sf^dng, and converging point) are deterrruned based 
on the camera-to-object distance information, the mag- 
nitude of parallax of the genmted stereoscopic CQ 
images on the display device (or in a window cn the dis- 
play ecreai), and the viewing distance, so that easy-to- 
view isteVeoscopic CG Images are automatically gener- 
ated regardless of the display size, arid by horlzbifitally 
translating left-eye and right-eye imiages, binocular plar- 
allax of displayed inriages is automatically brought within 
the viewer*a binocular fusionai range regardless of tiie 
size of a stereoscopic display used. 
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Description 

BACKGROUND OF THE INVENTION 

1 .Field of the invention 

The present invention relates to a stereoscopic CO 
image generating apparatus for making stereoscopic 
vision possible b/ stereoscopically displaying tm- 
dimensional images generated from three-dimensional 
structural information, and also relates to a stereoscopic 
TV ^aparatus for displs^'ng a stereoscopic Image. 

S.Related Art of the Invention 

An example of a prior art stereoscopic image gen- 
erating apparatus is shown in Figure 10. According to 
this apparatus, three-dimensional structural informa- 
tion, describing a three-dimensional shape of an object 
by a surface model, is input (the object is approximated 
by a plurality of small surfaces called polygons, and the 
structural information defines the three-dimensional 
positions of the vertices of each polygon and the faces 
and edges formed by the polygons), and the object 
defined by this information is arranged in a world coor- 
dinate system. Then, projection transformation sections 
1 arvl 2 calculate the two-dimensional positions of the 
object that would be projected on a film when photo- 
graphed by an imaginary camera, and rendering sec- 
tions 3 and 4 determine the brightness and color (6.g.. 
R, Q, B values) of an image within each polygon on the 
basis of the material of the object, the type of the light 
source used, and the three-dimensional positior^. 

For exampISp a geometric model of a polyhedron, 
such as the one shown in Rgure 11 (a), is described by 
the three-dimensional coordinates of vertices V1 to V8 
and the data structure (fornrting faces and edges) of the 
geometric model, as shown in Figure 11(b). and the 
object described 1^ this infornnatron is arranged in the 
world coordinate system as shown in Rgure 12(a). 
Then, an image (vertices) of the object projected on a 
saeen 50. as viewed from viewpoint E of the camera, is 
calculated. Next, the positions on the screen of the 
faces and edges formed by the vertices and their bright- 
ness and color are calculated to produce an image for 
output. At this time, in order to produce a stereoscopic 
image, images as viewed from at least two viewpoints 
need to be ^Icutated; therefore, camera parameters 
must be specified as shown in Figure 12(b], that is, 2Wc 
which is the spacirig between a plurality of cameras, CL 
and CR which are the positions of the camera view- 
points, P which is the three-dimensional coordinates of 
thfe converging point of the cameras, and f which is the 
focal length of the cameras (or 6 which is the field of 
vim). 

Figure 18 shows an example of a prior art stereo- 
scopic TV apparatus for displaying a stereoscopic 
image. 

This apparatus comprises two CRTs with crossed 



polarizing filters attached to their respective display sur- 
faces, and a half-sivered mirror is used to combine the 
two display images. When viewed by a viewer wearing 
glasses constructed from oonresponding polarizing fil- 

5 tars, the images are shown to the viewer's left ^e and 
right eye. respectively 

However, In the above prior art stereoscopic CO 
generating apparatus, the plurality of camera parame- 
ters have to be changed according to the viewing die- 

10 tance and screen size, but in actuality, these parameters 
are acljusted by a CQ opmtor, t>ased on his experi- 
ence, by viewing the generated stereoscopic CQ 
images and setting the parameters so that an easy-to- 
view image can be presented to the viewer. There is 

IS tiieretore the problem that if stereoscopic CG images 
generated with improperly adjusted parameters are dis- 
played on a stereoscopic image display device, the bin- 
ocular parallax of the stereoscopic images (expressing, 
for example^ the difference between the horizontal posi- 

20 tions of the same vertices In the left and eight images in 
terms of view angle) often exceeds the allowable range 
of the viewer, resulting in unnatural st^eoscopic 
ineges that tend to increase ^e strain. 

In view of the above problem of the prior art stereo- 

25 scQpic CG image generating apparatus, it is an object of 
the present invention to provide a stereosocpic image 
generating apparatus that can automatically generate 
natural and easy^to-view stereoscopic images for a 
viewer regardiees of the viewing distance and screen 

30 siza 

In the case of the prior art stereoscopic TV appara- 
tus, when the same stereoscopic image signal is input, 
if the screen size is different, tfie binocular parallax of 
displayed images is also different. Rgure 19 explains 

S5 this: that is^ binocular parallax As on a small display 
screen (a) increases to AL on a large dlspl^ screen (b). 
If this binocular parallax becomes too large, the viewer 
will have difficulty in achieving stereoscopic vision, thus 
increasing eye strain. 

4o Difficulty In achieving stereoscopic vision means 
that if binocular parallax AN becomes large, and the 
distance between the image display screen and point P 
where the object is perceived for stereoscopic viewing 
increases, as shown in Rgure 20(a}, there arises a con- 

4s ffict between the adjustment of the viewer's eye lenses 
and the distance perceived by stereoscopic vision, and 
Of P moves further closer] binocular stereoscopic vision 
cannot be achieved. In the case of Rgure 20(b), in ster- 
eoscopic images an ot)ject at distance » is displayed 

50 with binocular paraOax coinciding with the interpuplllary 
distance of the viewer. If the birxx^ular parallax AF 
becomes larger than that, the viewer will be unable to 
achieve t)inocular stereoscope vision. 

For recent computer graphic terminals, multisync 

6B monitors are widespread that can be switched between 
miJti|3le resolution modes. The resolution (display fre- 
quency) can be switched over a wide range, for exam- 
ple, from a low resolution nrxKle of 640 x 400-pixel 
saeen generally used for personal computers to a high 
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resolution mode of 2000 x 1000-pixel for workstations. If 
one muftisync display is used to swftch between these 
inrage signals, thedi^layed size of an Image cor^tsting 
of the same nunri^er of dots varies aocordlng to the res- 
olution of the image signal because the display screen -5 
size is the same. Figure 19 shows this: that is. part (c) 
shows a display of a low-re^lution image signal, and 
part (d) shows a display of a high-resotution in^e sig- 
nal. In part (dj; the displayed. image' is smaD, while in 
part (c), binocular paraDcuc As is larger than At . 10 

When stereoscopic GG inrciges or the fike are dis- 
played on such a (Ssplay. binocular paraOax of di^layed 
Images varies grmfly accordktg to the Image resolution^ 
in Gome cases making it <^icult for the view to achieve 
etereosocapic vision and thus ter^iling to inpfase eye is 
str^n. 

CXirrently. there are three types of tKoadcast video 
slgnais, HDTV, EDTV, and NTCC. "Oiese s'gnal fpnnats . 
diffdr not only in resolution but also bi screert^aspect 
rattob. and hence, there arise differences in display eize. 20 
Furtherrnore, in some display methods, the eize can be 
changed as in a windowing .environment Acoofdingty* 
binocular parallax of displayed images varies. greatly, in 
some cases making it difficult for the view to achieve 
stereoscopic vision and tending to increase eye strain, 2S 

. The present invention Is also intwded to resolve 
the above-outlined problems involved In stereoscopic 
presentation of nabiral image8,!and it is also an object 
of the invention to make it possible to produce esasy-to^- 
view, natural-looking stereoscopic images by automali- 30 
cally adjusting the amount of Isinoailar parallax accord- 
ing to the screen (window) size emn when the same 
etereoscopic image signal is input. 

SUMMARY OF THE INVENTION SS 

According to the preserrt invention, the fusional 
range computing means computes , the binocular 
fusional range of the viewer viewing the screen of the 
stereoscopic image display device for displaying the 40 
stereoscopic image of ^e object, on the basis of the 
pre-entered parameters consisting at least of the size of 
the saeen and the viewing distance between the 
screen and the viewer, and the camera parameter cal- 
culating means calculates the condHions for camera 45 
parameters, based on the binocular fusional range and 
on the object-to-camera distance generated bjf the dis- 
tance information extraction section, so that the object 
in its entirety can be brought within the viewer's binocu- 
lar fustonal range; then, using the camera parameter so 
determining eection, the CO operator determines the 
camera paranneters based on the output of the camera 
parameter calculating ' means, and based on three- 
dimensional structural information descn'bing a three- 
dimensional shape of an object, using the thus deter- es 
mined camera parameters, the projection transforma- 
tion section generates the plurality of two-dimensional 
projection images as viewed from the plurality of cam- 
eras. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Rgure 1 is a cfiagram showing the configuration of a 
stereoscopk: OQ image generating apr^ratus 
according to a first embodiment of the present 
irwention; 

Rgure 2 Is a diagram showing the relatior^hip 
between an object and camera positions in a CO 
space (worid coordinate system) according, to the 
present invention; 

Figure 3 is a diagram showing a viewer space 
(defirung the space where stereoscopic images are 
viewed) according to the present inventton; 
Rgure. 4 is a diagram showtng a stereoscopk; 
inrage parallel shooting method accorcfing to the 
preserrt invention; ,^ . ^ . 

Figure 5(a) is a diagram stiowing an example <^ a 
display produced on a display section in an opera- 
tfon section according to the first. emtxxfiment...and 
Rgure . 5(b). is a diag^Bm showing an qperatfon 
panel of the operation section; . 
Rgure 6 is a <fiagram showing the conf juration ol a 
stereoscopic CX3 image g^erating apparatus 
according to a second embodiment of the present, 
invention; 

Rgure 7 Is a diagram showing the configuratton of a 
stereoscopic OQ image g^erating apparatus 
according to a.tNrd embocfiment of the present 
irivention; 

Rgure 6(a) is a diagram showing the concept, of 
nearxlippaig and 1^ clipping (independently for left 
and right cameras), and. Rgure 6(b) Js a diagrann 
showing the concept of near clipping and far clip- 
ping (common to left and right cameras) according 
to^ the, third embodiment;- ... 
Rgure.9 is a <fiagram showing the configuration of a 
steremcopic OQ inrKige generating apparatus ^ 
according to a fourth embodiment of the present 
invention;^ 

Rgure 10 is a diagram showing the configuration of 
a stereoscopic CQ image generating apparatus 
according to the prior art; 

Figure:11(a} is a diagram showing an example of a 
geometric model for explaining thre&dlmenslonal 
structural infonhatioa and Rgure 11(b) is a dia- 
gram showing data structure of the geometric 
rnodel; - 

Figure 12(a) is a cfagram showing a world coordi- 
nate system and projection transformation, and Rg- 
ure 1 2(b) is a diagram showing camera parameters; 
Rgure 13 Is a diagram showing the configuration of 
a stereoscopic CG image generating apparatus 
according to a filth embodiment of the present 
invention; 

Rgure 14 is a diagram showing the corrfiguration of 
a sta'eoscopic TV apparatus according to a sixtii 
embcdi ment of the preserrt invention ; 
Figure. 15 is a diagram showing the operation of a 
parallax calculation section according to the 
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present invention; 

Figure 16 ^ a diagram showing the configuration of 
a stereoscopic TV apparatus according to a sev- 
enth embodiment of tiie present invention; 
Rgure 17 e a diagram shewing a time-multpiexed s 
stereoscopic image signal according to the seventh 
embodiment of the present invention; 
Rgure 18 is a diagram showing the configuration of 
a stereoscopic TV apparatus according to the prior 
art; to 
Rgure 19 is a diagram showing relationshf)s 
between binocular parallax and display image size 
and Image resolution; 

Rgure 20 is a diagram showing a vlevwerle binocular 
fusional range; is 
Rgure 21 is a diagram showing the configuration of 
a stereoscopic TV ^aparatus according to an eitfrth 
embodiment of the present inventton; and 
Rgure 22 is a diagram showing the relationship 
between viewing angle of display screen and binoc- so 
ular fusional limits. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

25 

(Embodiment 1) 

Figure 1 is a diagram showing the configuration of a 
stereoscopic CO image generating apparatus accord- 
ing to a first embodiment of the present invention. In so 
Rgure 1, reference numerals 1 and 2 are projection 
transformation sections and 3 and 4 are rendering sec- 
tons; these eections are the same as those used in the 
prior art stereoscopic CG generating apparatus. The 
present ennbodlment differs from the prior art stereo- 35 
soopic CO image generating apparatus in that a dis- 
tance information e3ctraction section 5. a fusional range 
verification section 11, a camera parameter determining 
section 6, and an operation section 12 are added. The 
fusional range verification section 1 1 includes a fusional 4o 
range calculating nneans and a camera parameter cal- 
culating means. 

The operation of the stereoscopic CO image gener- 
ating apparatus of the present enrtodiment vvill be 
described below. First, three-dimensional structural 4s 
information, describing a three^iimensional shape of an 
object by a surges model, is input to the projection 
transformation sections 1 and 2 as well as to the dis- 
tance information extraction section 5. While cheddng 
the output images produced on a stereoscopic innage so 
display device (not shown) connected to the rendering 
sections 3 and 4, a CO operator ananges tfie object and 
an imaginary camera (at mid^int between left and right 
cameras} at appropriate positions in the world coordi- 
nate system as he desires, thus determining its direc- 6S 
tfon. The left and right cameras are arranged at 
positions of -Wc and -t-Wc, respectively, along the x-axis 
with the imaginary camera position V at its origin (see 
Figure 2). H is assumed hers that the camera parame- 



ters at this time (the camera spacing Wc, the focal 
length f, and the distarK;e dx to the oonverging point to 
be described later with reference to Figure 3} are preset 
as initial values. (The camera spacing Wc used here 
refers to half the distance between the left and right 
cameras. The same applies hereinafter unless other- 
wise stated.) 

Next, the distance information extraction section 5 
extracts from the object a point nearest to the imaginary 
camera (near point fsl) and a point farthest from the 
imaginary cannera (far point F). The x. y coordinates ol 
these points are calculated, and defined as N(XN, YN, 
ZN) and F(XF. YF. ZF=). respective^ (see Rgiff^e 2). If 
these two points both fall within the binocular fusional 
range of the viewer, a good stereoscopic CG image is 
obtained, bi this case, the far point and near point may 
be determined comprehensively by calculating the aver- 
age ol the distances from the imaginary camera and left 
and right cameras, etc. 

Based on the three-dimensional coordinates of the 
near point N and far point F, arKi on the viewer's viewing 
distance ds and the screen size M of the stereoscopic 
mnage displeiy device on which stereoscopic CO images 
are displayed for viewing (ds and M are parameters 
entered in advance), the fusional range verif icalion sec- 
tion 1 1 calculates an effective range (where the viewer 
can achieve binocular fusing) of the camera parameters 
(camera spacing Wc, camera focal length f. and dis- 
tance dx from camera converging point to imaginary 
camera position V). Viewer space parameters are 
defined as shown in Rgure 3. 

Mathematical expressions for the calculations are 
give below. 

Near point condition: [Mathematical 1] 

2 - d3 • tan^ < - -g-^ {<S>1 +2AS 



Far point cordition: [Mathematical 2] 

/ MfWc ^ \ 

or 2Wo > - -g^ {® } +2AS J 

where 

^(Xn+Wc)+Ym 5^(Xn.Wc)+Y^, 
Yn+^n+Wc)^ Yn.(Xn-Wo)^ 
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where 2 x AS indicates the phase difference between 
left and right images ,on the etereosccpic image display 
screen; usually. 2 x AS is set equal to the viewer^ inter- 
pupillary distance (about 60 mm). Further, D- and P+ 
repress binocutar parallaxes at the nearest point and 
the farthest point, raspedively, wHhin the range where . 
the vfeiver can achieve bIrK)cu!v fUsipfi. 

The focal terigth land the held of view, e, ofa.cann- 
era have a unique relationship vwth each other as 
expreisBed P^afthenW^ 



10 



[Mathematical ,3 1 



^2 



, 1 
2*f 



therefore, either, may be usedrtp d^ine the parameter. 
Al6p,xixcan beautoniatically.detenrruned the camera 
position and the three-dimensional position of a |X)ifit tp , 
which thfi[ camera is dir€K:ted.,11ie fusi.or^ range yerff^^ 
cation eecUon, 11 calculeteeev^ possible.conr^ination 
of the carnera ispac^ing Wc, carneia focal length f, and, 
distance. dxJfrom W P to irnagi- . 

nary cairfiia position V, th^ satisfies both of the above 
expreissions. ..-t . 

In Mathenmtical 1> Df and b- indicate the limit val- 
ues inside wlilch the viewer can actiieye binocular^ 
fusion. These values d[ei>encl on the size of the image 
display screen; pre$ented^to-th^ .viewer. The fusional 
range verification section li stores^in adva^^ the vatr. 
ues ofifie binocular ^sionsU range <preq90i]^ to the 
image dl8pls^;SCTeeni, and ta^ on jmem^evalMates, 
the viwer's fuaon^ ^ . 

Next, the canriera paramrieter<^ section 6;. 

deternrdnes. wliich or the cam^a .parameter cornbina- . 
tions calculated by the fusional range verification sec- 
Bon 11 is to be, used. ; 

f^or example^ one of tfie following methods is used. < 

(1) WNIe GhecMng the output images by operating 
the operation section 12, the CQ oper^or tries var- 
ious camera parameter cornbinations calculated by 
the fusional range verification section 11 and 
selects one that he thinks g^yes the best result 

(2) The CQ operator fiiet determines one of the 
camera parameters. Wa f. and dx, then, changes 
the remaining two parameters., by operating . the- 
operation section 12.: arbitrarily wittiiri . parameter 
combinatipnG.. presented from the fusional range . 
verification section 1 1 . (combinations of the two 
parameters that satisfy the expressions of Mathe- 
matical 1 and Mathematical 2), and v/hile checking 
the output images, determines.the combination that 



he tfnnks give the best result. 
(8) The CG qjerator first determines two of the 
camera parameters, Wc, f, and dx, then, changes 
the remaining one parameter, by operating the 
operation section 12, arbitrarily within the parame- 
ter range presented fromihe fusional rar^e.verffi-. 
cation section 11 (the range of ^e one parameter 
that satisfies' the expressions ^of Mathematical 1 
and Mathematical 2), and whDe checMng the output 
images, detemrtines one that he thinte gives the 
best result. 



The niethods of (1) to (3) wiD be descrbed in further 
detailJ^elow^ -.^ / 

IB In ttie case of (1). a region (effective region) defin- 
ing combiriations of parameters, Wc. f, and dx, where 
the viewer can achieve binocxijar.f^ |s displayed, - 
along with a poirtter 13 indic^ng the current «>mbina- 
tion of Wc, f . and dx, on a display section arranged on 

20 the operation section :1 2, as shov^ 

; THe CG operator cNviges. 1he,.po8itiori of -the 
poiriter by; using a^three-dinfiensiofial or tfie Gke. 
At this time, the^yalues of vyc.jF.^andjc^ change as the 
pointer position, Gtanges, but;, the pointer .cannpttbe 

25 nwved puteade effective regipn. The pararruatersiat 
the coprdir^te position ppjnted to by the pointer are out- 
put to thecarnera parameter deterrnining sectipn 6, arid 
stereoscopic images' to beputput are calciilated by-tfie- 
projection transfiorn»tion sectimtl;.arid 2 a^ 

30 dering sections 3 and 4. By viewing the image produced 
on the stereoscopic image cfisplay device, the CGiOper- 
ator adjusts ttie positipri of the pointer as he desires. In 
this way. control is. pertorrned so. that the output stereo- 
scopic CQ images are always produced within the 

35 .viewer's binocular fusional range. 

In the^case of (2). and (3), as shown in Figure 5(b}, 
a controlcpanel. 1 2a:is prpyided^which.cpnprises-three 
volumeconf pis 1 4.. t?. arid 16 foradjusting the respec- . 
tive/pararneters. aid thi^^^ 18, and 19 . 

4o for loddng-the respective pararneters^ . It . is assurned 
here that.initial.ly the locic buttons are riot pressed ON, 
Whiie viewing the output stereoscopic C<3 image, first < 
the CQ operator selects, for example, the focal length f 
out of the camera pararneters and deternrrines to.set jt to 

45 to on tfie operat'ori pariel 12a (Figure 5(b)) by consider- 
ing the field of view. The operator then sets the volume 
oontrpi 14 to fO aind presses the lock button 17. The 
pararneter f is thus locked to fO. When the parameter f is 
loctod, the fusional range verif icatton section 1 1 calcu- 

50 lates combinations of the remaining parameters Wc and 
dx which satisfy both Mathematical 1 and Mathematical 
2. 

Next. the.CQ operator :Change5 the pararneters Wc 
arvl dx by operating the yplume controls 15 ard 16 vuhile 
Bs checkir^.the output Images. Here, provisi pns are made 
so that the parameters Wc and dx that the CQ opmtor 
is goi rig jto set can be changed only within the rang es of 
Wc and dx values that satisfy both Mathematical 1 and , 
Mathernatlcal 2.. At this time, one or the otherof the two 
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parameters, Wc or dx. can be locked by the lock button 
18 or 19. Then, only the remaining one parameter is 
changed while checking the output stereosoopic CG 
images. In this way, the parameters can be determined 
one by one while constantly imping the output stereo- 
scopic CQ image within the viewer's binocular fusional 
range. 

Using the camera parameteis Wc, i, and dx deter- 
mined in ttie above manner, the projectk)n transfonro- 
tion sections 1 and 2 calculate the two-dimensional 
positicns of the object that would be projected on films 
when photographed by the right and left cameras, 
respectively, and the renderir>g sections 3 and 4 deter- 
mine the ixightness and color of an image within each 
polygon on the basis of the material of the object, the 
type of the light source used, and the three-dimensional 
positions. Finally, stereoscopic CQ images for the left 
and right eyes are output 

The present embodiment has been described by 
assuming the camera arrangement for convergir^g 
shooting (in Figure 2, the left arKi right cameras 7 and 8 
are arranged both pointing in the direction of point P). 
Alternatively, the left and right cameras may be 
arrariged in parallel to each other as shown in Figure 4. 
In this case, the fusional range verification section 11 
need not use the three-dimensional ooorcfinate values 
of the far point of the object, but need only calculate 
combinations of Wc arvj f that satisfy the condition 
expressed by Mathematical 4. 

[iViathematical 4| 

^c<-iarCcIs-tan|--AS) 

(Tliis setting is equivalent to setting dx at 

In the present embodiment, the limits of the 
viewer's binocular fusional range are given by Mathe- 
matical 1 and Mathematical 2. Alternatively, D- arKi D-i- 
in these expressions or depthwise distances corre- 
sponding to these parameters may t>e entered manually 
bytheCQopeiator. 

In the present ent>odiment. the camera parameters 
are dalermined based on one CQ Image data, but In the 
case of moving images also, the camera parameters 
can be determined in like manner fc>y using CG image 
data at each of successive time instants. Furthermore, if 
a camera parameter sequence over a certain period is 
determined and stored in advance, it is possible to play 
t)ack the same scene any number of times by using the 
stereoscopic camera parameters having the same pat- 
tern of change. 

As described above, according to the present 
embodiment, the camera-to-object distance information 
and the magnitude o1 parallax of generated stereo- 
scopic CQ images on the display device are calculated 
from the size of the display device and the viewing dis- 
tance, and by checking whether the CQ images fall 
within the viewer's binociriar fusional range, proper 



camera parameters (focal length or field of view, camera 
spacing, and converging point) are determined. In ttiis 
manner, easy-to-view stereosoopic CG images can be 
obtained automatically. 

5 

(Embodiment 2} 

Figure 6 is a diagram showing the configuration of a 
stereoscopic CG image generating apparatus acoord- 
10 ing to a second embocf ment of the present invention. In 
Figure 6. reference numerals 1 and 2 are projection 
transfbmiation sections. 3 and 4 are rendering sections, 
and 6 is a camera parameter determining section; these 
sections are the same as those used in the stereoscopic 
IS CG generating apparatus of the first embodiment. The 
present embodiment differs from the stereoscopic CG 
image generating apparatus of the first emtxniiment in 
that the distance infonration extraction section 5 and 
fusional range verification section 11 in Rgure 1 are 

20 replaced by a paraBax map calculation section 20 and a 
fusional regk>n jud^ng section A 21 which acts as a 
pixel count calculating means. 

The operation of the stereoscopic CQ image gener- 
ating apparatus having the above configuration will be 

25 described belowi 

The present embodmnent Is particularly effective In 
cases where, of the camera parameters Wc, f, and dx, 
at least one parameter, specifically Wc. is fixed by the 
CQ operator and, when output wHhout any adiustment, 

30 the entire stereoscopic CG images cannot be tsrought 
within the viewer's binocular fusional range. 

Thre&<iimensional structural Information, desaib- 
ing a three-dimensional shape of an object by a surface 
model, is irput to the prpt^rtion trarsformalion sections 

35 1 ama 2. As in the first embodiment the CG operator, 
while cheddng the output images produced on the ster- 
eosoopic image display device (not shown) connected 
to fhe rendering sections 3 and 4, arranges the object 
and the imaginary camera (at midtx}int between left and 

40 right cameras) at appropriate posittons in the world 
coordinate system as he desires, thus determining its 
direction. The left and right cameras are arranged at 
positions of -Wc and +Wc; respectively, along the x-axis 
with the imaginary camera position V at its origin (see 

45 Figure 2}. The camera parameters Wc, f, and dx used 
here are preset as initial values (at least one of these 
parameters is fixed). 

Using these preset parameters, the projection 
transformation sections 1 and 2 convert the three- 

so dimensional structural Information Into images pro- 
jected on a two-dimensional screen, and the resulting 
inreges are fed to the rendering sections 3 and 4 which 
then generate CQ images. 

From the outputs of the rendering sections 3 and 4 

55 and the three-dimensionaJ structural irrformation, the 
parallax map calculation section 20 calculates the depth 
data of the left and right images at each point of the pro- 
jection-converted images, that is, a parallax map (an 
image showing the amount of depth at each plxe^. For 
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example, by using results of Z txiffer processing, a popr 
ular technique used in CG, it is ppssfole to obtain the 
amount of depth at each point on the screen, and it ^ 
easy to construct a parallax nriap using tWs technique. In . 
the case of images such as wireframes that do not 5 
involve rendering, a parallax map is constructed using 
the outputs of the prcjection tnansfomiation sections 1 
and 2 and the three-dimensional sbiictural infprrnation. 

Based on tfie parallax map, the.fuaormj region 
judging section A 21 calculates.the number of pixete; 10 
(this is defined as the effective pixel ^cou^ 
nunr^er of vertices of polygons. Of the 
points of polygons, tat are oo^^lr)edJn a.r^onont^^ • 
screen tliet lies within the btnocidar^fusonal roTge o^^^ 
viewer viewing the^ stereoscopic OG jnviges (ttie : is 
fusional range js a mnge where t^^ a 
value between b- and p+. Jhese values bcMng.dege^ 
ent .pn fhe.screen size, and a da^ase storing.tiiese 
values is indialed jn the fusional regjon judging section; 

^l^itoxt,. :White successK^ : the. camera;... 

pararneters Wc,>f, Euid dx/^e fujuomd reckon judging - 
s^'on A 21 calculates, based on the output of the par- ; 
aUax map calculation section 20. the effective pi3(»l 
count for every posfi'ble combination of Wc, f , and dx 
within preset variation ranges. excliK^ing, hovwever. the 
pareuTieter v^pse va^^^ . , v? r 

Then, the camera p^ameter cietermining section 6 
conputeslh? paramet^ 

largest ^effiac^ pixel coint of all the combinations of . so 
the parameters Wc, f, and dx fbr wttich the efftetive pixel 
count has been caJculated. The thus computed param- 
eters, Wc, f, and dx, are suppGed to the projection transr . 
formation sertionsJ and 2. - > ^ ^ 

At thiS ; time,vrathertt[ian ^w^^ maMirwm, ss 

value of the effective pixel .count a. number of combinar. 
tions that prpyide^the effective pixel count close to the 
ma)dmum value may be pre^^ ; . 

CQppeiat(Krand,the select 

pOed to jheprqjec^n:tran^ ^ 4q 

F-urtherrnore, pf the.three parameters, one or more 
parameters, may be fixed, and the camera parameter 
determining section 6 rriay t>e made to prefsent the conv.. 
bination.of the retraining: paranieters that prpvides the 
largest effective pixel count, or to present a nunib»erof. 4b 
conrtunations of the remaining.parameters tfiat |>rovide 
the effective pixel courit close to the maximum value, for 
selection by the CQ operator. 

Using the parameters thus supplied, the projection 
transfbnratiqn sections 1 and 2 and the rerxierlng sec- : so 
tions 3 and 4 compute final stereoscopic CQ innages In 
this way. the camera parameters can be auton^tically ^ 
determineid to maximize the image portion that falls ^ 
within the viewer's binocular fusional ranjga \: i ^^iV* 

If tiie effective pixel count thas a plurality of iimaxi- . 55 
mum values, stereoscopic CO. images are gerierated ^ 
using the parameters for the respective cases, and the 
CQ operator , selects the desired.:Gpmbiriation \Of the^ 
parameters by checking the results on the ^ereosoopic^ , . 



image display apparatus. 

As de^ribed, according to the present ernbocfi- 
ment, even in cases where there are limitations on the 
camera parameters and the entire stereoscopic CQ 
images produced for final, output cannot be brought 
within tiie viewer^ binocular fusional range, the camera 
parameters Wc, f, and dx can be automaticany;deter- 
mined to maximize the .image area that falls within the 
binocular fusional range, v . h ^ - 

Jn the second, embotfimer^ described atwwe, the 
near point and far point of the object may t>e confuted 
from the parallax nriapL^ai^d tiier^er. t^e^^ til^ 
results* tf;^ vSterepmpjc carnera parameters rhay^ be 
detarmiried usirig.tfie 6anr« metf^ 
fi^ernbodiment. - . 

■ - " '~ ^': . . - ^ ' • ' - ' ■ • 

(Enribodiment 3) : k ^ 

Figure 7 is a (fiagram shcwring.the^OT of a 

stereoscopic CQ inriage generating apparatus accord- 
ing tq^ a tNrd eni3odimerit <^ the* present inveritlon. In 
FfguD;er<?,. reference. numerals si and^^ are projection, 
transformation sectiona 3 and 4 are remlenng sections. 
6 is a canriera parameter deternrtining section, a^ is 
a parallax map caicukticniiS^ these sections are 
tiie same as those used jn the stereoscopic CG image 
generating.apparatus of jthe sec^ OTbodiment. 

,The;differenpee frpm: the stereoscopic CQ image 
generating- apparatijs: cl the .second embpdiment^are 
that the ihjsipnal regi'OT j^ section A 21 is replaced 
by a fusionai^,regpon;jijdging 

coum calculating means, and that a dipping^ value 

detenTiming secti.on.22 as asp^ 

section isjadded. y-Ti- J ^ ..^ ; , j. - 

fhe operation of t^ image gener- 

ating apparatus havirig the abp^y^e conf iguration will t>e 
de6ciribed;bekjw FJrsj^ the.camera par^ 
ing sec^on sVdeteiTrine^ (VVb, 
dx. Q tQ,'su|^|y:tp IJie proj€fCtipn tran^mation.secti 
1 and 2 in the same nnanner €S described in the forego- 
ing secoridemtodinii^. ; 0 ^ : 

.While checking the output Images produced on the^ 
stereoscopic image; display device connected to the 
rendering sections 3 and; 4. the CQ operator arranges < 
tiie object and the imaginary, camera at appropriate 
positions in the, world coordinate system as he desires, 
thus determining its direction. ; • >; 

Using the thus set parameters, the projection trans- 
formation sections 1 and 2 convert the tliree-d|men- 
sional structural Infomnation into Images ivojected on a 
two<limensional screen, and tiie resulting images are 
fed to the rendering sections 3 and 4 which then gener- 
ate CQirnageci. . -A , f. , :•>: : 

Frorn^the outputs of title rerideringtsectH^ns 3 and 4 
arvi the three<limenslonal structural information, the 
parallax map> calculation section 20. calculates a paral- 
lax map at. each. pp.int^of:;th.e projection^nyerted 
Images. - . -y. ■ • * 

Based on-thKs paraltax .maPi. the.fUsional region 
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judging section B 2 V calculates the effective pixel count 
of the region on the screen that lies within the birx>cular 
fuslonal range of the viewer viewing the stereosoopio 
CG images, and while successively changing the cam- 
era parameters Wc. f. and dx. cafculatds the effective 
pixel counli on the basis of the output of the parallax 
map calculation section 20. 

The fusional region judging section B 21' has a 
datalKse defining relafionshipe between ecreen size 
and fusional range, and calculates the effective pixel 
count by referencing this database. 

Next, the camera paran^er deter minir^ section 6 
computes the parameters Wc, f, and dx that provide the 
largest effective pixel count of all the combinations of 
the parameters Wc; f , and dx for which the effective pixel 
count has been calciiated. The thus computed param- 
eters, Wc, f. and dx, are supplied to the projection trans- 
formation sections 1 and 2. 

Using the parameters thus supplied, the projection 
transtormation sections 1 and 2 and the rendering sec- 
tions 3 and 4 compute final stereoscopic CG images. 
Once the camera parameters have been determined, 
their values are f i)sd. 

Here, consider the situation where the object is 
moved or the left and right cameras are moved while 
maintaining their poeltionai relattonsh^x If the cameras 
are moved toward the ol^ect, the distance to the object 
decreases, and the binocular parallax increases, even- 
tually exceeding the viper's binocular fusional range 
The same applies for the far point. To address this prob- 
lem, dipping is applied while holding the camera param- 
eters fixed. 

In conventional CG image proces^ng, the render- 
ing sections 3 and 4 would apply clipping to a near 
object and a obiect so that th^ would not be dis- 
played, bi the present embodiment on the other hand, 
values defining such clipping positions are detemfined 
for the rerKlering sections 3 and 4. as shown in Figure 
8(a}, so that images outside the binocular fusional 
range will not be output. 

That is. the fusional region judj^ng section B 21" 
calculates the linnits (near Gmit and far lin^] of the 
viewer's binocular fieional range. More spedTicaly, in 
the world coordinate system of Figure d(a), all points 
that satisfy Mathematical 1 and Mathematical 2 are 
computed. In Rgure 8(a}, the region consisting of such 
points is defined as the shaded region. 

Next, a near cipping value. CLN, and a far clipping 
value. CLF, are determined so that those points lying 
outside the shaded region will not be Included in the 
final CG images output for d^Iay. (CLNR and CUML 
are near clipping planes for the rig^ camera and left 
camera, respectively, arxJ CI-FR and CLFL are far clip- 
ping planes for the right camera and left ^mera. 
respectively.) 

Only objects lying within the region bounded by the 
near clipping planes and tar clf>ping planes are output 
from the rendering section 3 and 4. 

In tfie above example, the cipping planes, CLNR, 



CLNL. CLFR, and CLFL. are set for the right and left 
cameras, respectively, but alternatively, a near dipping 
plane CLCN and a far clipping plane CLCF may be 
determined with respect to the imaginary camera (ori- 

5 gin), as shown In Figure 8(b) and these may be L«ed 
common to the right and left cameras. 

In the present embodiment, if there is an object 
lying in a region to be clipped away, settings are made 
so that such an otsgect will not be included in the final 

10 images output for display. Alternatively, provisions may 
be made to gradually lower the contrast of the object or 
decrease the color intensity of the object as the object 
approaches a region to k>e clipped away. In this case, 
since the object vanishes in a natural manner as it 

75 enters a region outside the viewer's binocular fusional 
range, unnaturalness can be greatly reduced in the ster- 
eoscopic CG images ou^xit lor dlsp^. 

As described above, according to the pr^ent 
embodiment even when the camera parameters are 

20 fixed, by setting suitable clipping planes considerirtg the 
viewer's binocular fusional range the final stereoscopic 
CG images output for display can be brought within the 
viewer's binocular fusional range. 

S5 (Embodiment 4} 

Figure 9 is a diagram showing the configuration of a 
stereoscopic CG image generating apparatus accord- 
ing to a fourth embodiment of the present invention. In 

30 Figure 9, reference numerals 1 and 2 are projection 
transformation sections. 3 and 4 are rendering sections, 
6 Is a camera parameter determining section, 20 is a 
parallax map calodaUon section, arxJ 21' is a fusional 
region judging sectbn B; these sections are the same 

55 as those used in the stereoscopic CG image generating 
apparatus of the thh'd embodiment 

The difference from the stereoscopic CG image 
generating apparatus of the third embodiment is that the 
clipping value determintng section 22 is replaced by a 

40 focus parameter determining section 23 and a fog effect 
parameter determining section 24. these parameters 
being contrded in accordance with the amount of bin- 
ocular parallax of the object concerned. The locus 
parameter determining section 23 and the log effect 

45 parameter determining section 24 together constitute a 
specific image processing section. 

The operation of the stereoscopic CG image gener- 
ating apparatus having the atx>ve configuration will be 
described below. First, the camera parameter determin- 

50 ing section 6 determines the camera parameters (Wc, 
dx, Q for the projection transfbnmation sections 1 and 2 
in the same manner as in the foregoing third embodi- 
ment. 

While checking the output images produced on the 
SB stereoscopic image display device connected to the 
rendering sections 3 and 4. the CG operator arranges 
the object and the imaginary camera at appropriate 
positions in tiie world coordinate system as he desires, 
thus d^ermining its direction. 
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After that the projection transformation sections 1 
and 2 convert the three-dimer^'onal stnictLiFal informa- 
tion into images projected on a two^mensiorHl screeri. 
and the resulting images are fed to the rendering sec- 
tions 3 and 4 wtiich then generate CG images. 5 

Next, from the outputs of the rendering sections 3 
and 4 and the three-dimensional structural tnfprmatiqn, 
the paraDax map calculation section 20 calcutetes a par- 
allax map at each point of the projection-converted 
images. Based on the para^ map, the fusional region io 
judging section B 21* calculates the effective pixel count 
of the respon on the screen that lies within the binocular 
fusional- rar^e of ttie viewer viewing tfte stereoscopic 
CG images, and while successively changing the cam- 
era parameters Wc, fp and dx, calculates the;effective is 
pixel cotjnt on the basis of the output oiP the^i^arallax 
map calculdion section 20. The fusional region judging 
section B 21* has a database defining relationsh9>& 
between screen size and fusional range, and calculates 
the effectiye pixel count tsy referencing this databaea . , 2o 

Next, the camera parameter determining section 6 
computes the parameters Wc, f. and dx that proyideG ^ 
the largest effective pixel, count of all the combinatons , 
of the paranrieters Wc, f, and dx for which the effective 
pixel count has been caloilated. The thus computed 2s 
parameters, Wc, f , and dx, are supplied to the projection 
transformation sections 1 and 2. 

Usifig the parameters thus €%ipplied, the projection 
transtornnation sections 1 and 2 and the rendering sec--. . 
tions 3 and 4 compute final stereoscopic CQ images, so 
Once the camera parameters fiave been determined., 
their values are fixed. 

In some cases, the rendering sediorts 3 and 4 intro- 
duce deliberate distortioris. such as defbcusing or fog- 
ging, distant objects, to express the perspective effect ss 
when generating final CO linages. v 

The locus parameter determining sec^^ and 
the fog effect parameter detenminfng section 24 deter- 
mine the degrees of defpcusing and fogging on the 
basis of the paralteoc nuip and the viewer's binocular 4o 
ffusiorial ranga 

For example, based on the output of the fusional 
regpon judging section B 21 '. the focus parameter deterr 
mining section 23 calculates those regions In the world 
coordinate systeni where the viewer cannot achieve 45 
binocular fusion. More specifically, three-dimensional 
coordinate positions that do not satisfy eitfier Mathe- 
matical 1 or Mathematical 2 or both are calculated. 

When rendering objects lying within such reports in 
the rendering sections 3 and 4. the locuS; parameter 
determining section 23 outputs such a iocus parameter 
as to give the output image a defocused and unclear 
appearance. 

If this effect is applied gradually increasingly as the . 
image nears a limit of the viewer's binocular fusional es 
range, a more natural defocusing effect can be given to 
the image. 

To achieve, the defocusing, effect a camera out-of- . 
focus corxiition may be simulated using traditional OQ 



techniques such as ray tracing, or spatial filtering (e.g., 
low-pass fOtenr^ may be appOed to the generated CG 
images. There s also a tet^nique in which, whDe suc- 
cessively changing the position of the object by small 
amounts aorarcfing to the degree of defocusing. the 
same object is written a number of times to the same 
image mentory, thereby blurring the edges. . If.the move- 
ment in changing the posHioh of the object is made pro- 
portional to the di^ance from ttie camera fbojsed 
plane, an out-of-focus effect can be achieved. (In the 
pr^ent embocfiment the movement shodd be made 
proportional to the distance from a limit of the viewer's 
binocular fiisional ranga) 

In tNs way, defocusing Is applied to objects for 
wtYtch the viewer cannot achieve binocular fusion. This 
has the effect of reducing the unnatLnainess arising 
vt^en birK)cular fusion cannot be. achieved. 

Similarly, based on ihe output of the fusional region 
judging section B 21-, the fog effect parameter determin- 
ing eec^ipri. 24 calculates , those regions in the .world . 
ooprdbiate system where the viewer, caniiot actveve 
binocular fusiori (especially, such regions where the^r ' 
point condition expressed by Mathematical 2 does riot 
hold). The fbg effect parameter determining section 24 
controls the fbg effect parameter so that . an effect is 
given tl^t makes these regions appear as if shrouded in 
fbg when the rendering sections 3 .and 4 rerider objects 
tying in these regions. . 

If the fog is riiade to. beoorrie thicker as the image, 
nears a Bnft of the viewer's binocular fusional rangei the 
scene descrtoed in the OQ images can be made to look; 
more natural with distant regions appearing as if hidden 
behind the fog. 

In this way, by applying the fbg effect when the bin- 
ocular paraOax is so large that binpodar fusion canrx)t 
be achieved, as in the case of distant objects, the unnat- 
ural feel that the viewer may have due to an inability to. 
achieve binocuiar fusion can be alleviated. 

In a specific method of producing a fog effect in ren- 
dering ; objects, a fog coefficient f (0.0 to 1.0) that 
decreases with increasing distanca for example, is con- 
sidered. Here, f = 1 means no fog. and when f = 0. the 
image appears completely washed put 

The degree of this effect cari t>e defined by Mathe- 
matical 5b Mathematical 6, etc.. where z denotes the 
distance firom the camera 

[Mathematical S] 

- f = (far- Z)/ far-near 

[Matfiematical 6] 

f = exp(-densityx2)" 

Here, far and near respectively indicate the farthest 
point and the nearest point from the camera in the gen- 
erated CG image, and density means the density of the 
fbg. Rendering color is cak^ulated by Mathematical 7. 
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[Mathematical 7] 

C = fxCo+(1-f)xC, 

Here, Co is the color of the rendered object, and Cf s 
is the color of the fog. The fog effect parameter deter- 
mirv'ng section 24 sets the coefficient f = 1 when the 
image is Inside the viewer's binocular fusional range; 
and smootily changes f down to 0 as the image nears a 
limit of the b'nocular fusional range and exceeds the io 
limit. 

In this way; the rendering sections 3 and 4 generate 
Images such that distant objects outside the binocular 
fusional range appear as if shrouded in fog, therebjr 
reducing the unnaturalness arising when the birvcular is 
fusional range is exceeded. 

As described above, according to the present 
embodiment, if objects are cSsplayed having such birm- 
ular parallax tf»t binocular fusion cannot be achieved, 
since fogging is applied to distant objects and defocus* 20 
ing is applied to near arxl distant objects, the ill effect is 
reduced and easy-to-view stereoscopic CQ images can 
be generated. 

(Ernbodiment 5) 25 

Rgure 13 is a diagram showing the configuration of 
a stereoscopic CQ image generating apparatus accord- 
ing to a fifth embodiment of the present invention. In 
Figure 13, reference numerals 1 and 2 are projection ao 
transtormation sections, 3 and 4 are rendering sections;, 
6 is a camera parameter determining section. 12 Is an 
operation eection, 1 1 is a fusional range verification 
section, 5 is a distance information extiaction section 
and 127 is a CO image generating section; these sec- 35 
tions are the same as those used in the first embodi- 
ment TTie difference from the first embodiment is the 
addition of the following sections: a window information 
management section 128, a window information man- 
agement control section 129, a mouse condition detec- 40 
ton section 130, a display screen size/dot count 
detection section 131 , a window size detection section 

132, a window generation/deletion detection section 

133, a window display position detection section 134. a 
window focus change detection section 135, a video 45 
signal converting section 136, a stereoscopic display 
section 137. a mouse 138, a pair of glasses with liquid- 
crystal shutters 139. and a viewing distance measuring 
means 140. 

The operation of the stereoscopic CQ image gener- so 
ating apparatus having the above configuration will be 
described belcw. 

In the present embodiment, multiple kirxis of stere- 
oscopic images are deplayed simultaneously in differ- 
ent windows of different sizes on a computer saeen in SB 
a windowing environnrtent which has reoentiy become a 
predominant operating environment On the otiier hand, 
in the first to fourth embodiments, the image displ^ size 
was the screen size of the display device itseH. 



It is assumed here that as shown in the stereo- 
scopic display section 137 of pQure 13, there are differ- 
ent windows. A, B, and C on the same screen, each 
showing a different stereoscopic image. 

Existing stereoscopic display techniques can be 
used to displ^ stereoscopic images, in the present 
embodiment the so-called time-multiplexing stereo- 
scopic image display technique is used in which stereo- 
scopic images converted by tiie video signal converting 
section 136 into video signals are input to the sl^eo- 
scopic display section 137 and the viewer views the 
stereoscopic images through the liquid-crystal shutter 
glasses 139. More specif icaly, the video signal convert- 
ing section 1 36 supplies the R and L video signals alter- 
nately, that Is, first R, then L, then R, then and eo on, 
in time nnultiplexing for display on the stereoscopic dis- 
play section 1 37; wfien the right-eye image is displayed, 
the rigm-eye glass of the liquid-crystal shutter glasses 
139 admHs light ar>d the left*eye glass blocks light, and 
when the left-eye image is displayed, the situation is 
reversed. In this way, the right-eye and left-eye images 
can be presented independentfy to the right eye and left 
eye of the viewer. Arty other exislirig stereoscopic image 
displ^ technique (such as using polarizers or lenticular 
lenses] may be empk^ed. Usually, the viewer is allowed 
to resize the windows A, B. and C as fm desires by 
using the mouse 138. 

When the display screen size of stereoscopic 
images changes as a result 0I a change in vrindow size, 
the viewer's binocular fusional range also changes. Fig- 
ure 22 shows Vie relationship between tiie screen size 
(viewing angle) for displa/ing stereoscopic innages and 
the maximum fusional parfdiax (expressed in angles, 
unit being [arc minD. It is shown that the allowable bin- 
ocular fusional range changes as the display screen 
size changes. A larger screen size provkJes a larger 
fusional range. Accordingly, when the window size is 
reduced while tiie window is displaying the same stere- 
oscopic image, the resulting parallax may exceed the 
binocular fusional range; therefore, the sizes of all the 
windows must be monitored cor^antfy, and the camera 
parameters must always be determined aocoidingly. 
More specrfcally, information about the window oper- 
ated by the viewer using the mouse is detected by tiie 
window information management control section 129, 
and based on the detected information, the screen sizes 
of all the windows currentiy displayed are supplied to 
the fusional range verifk;ation section 11. In operation, 
the windows orrentiy displayed are managed by the 
window generat'onAdeletion detection section 133, arxi 
the size of each individual window is determined by the 
window display position detection section 134. window 
size detection section 132, and display screen size^dot 
count detection section 131 . More epeciicaily. the size 
of each windbw actually displayed Qn inches, centime- 
ters, etc) is calculated from tiie display screen size (in 
Inches), tiie horizontal and vertical dot oourns of the dis- 
play (these c€m be comfxjted by detecting synchroniza- 
tk>n frequencies}, and the size of the window (dot 
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counQ. and the thus calculated window size is supplied 
to the fusional range verif'fcation section 1 1 . The screen 
size, for example, can be obtained by having the window 
information management section 128 control the video 
signal converting section 136 and the nunnber of dots s 
displayed on the stereoscopic di^y section 1 37. 

The remainder of the process Is the same as that 
desaS^ed in the firet embocfiment That is, the distance 
information obtained from the tfvee-dlrnensional stns- 
tuial information is detected by the distance inforrnatipn . io 
extraction section 5. and using this d^tance informattqn 
and the cSstance, tis, between viewer and displ^ su" 
measured 1^ the viewing; dislarioe measiipring. 
means 140, the canriera f^ram^ers are calculated by 
Mathematical 1 and IS/lathematical 2. The camera is 
parameters are supplied to the. projection transforma- 
tion sections 1 and 2, and the right-^ arxJ 1^:^ 
images, R and U are calculated by ^e rendering sec- 
tions S and 4, respecthrety. This processing is perfbrmed 
separate^ fa each of the stereoscopic display windows 2o 
delected by the window InfbnnaBon managemerit sec- 
tion 128. 

ijis described above, in a display system having a 
windowing environment for displaying a pluralify of ster- ^ 
eoscopic images, the window information nnanagement 2S 
section,128 supervises the size erf each window . 
camera parameters are controlled, a^ hence ttie paral- 
lax is'controlied, so that the stereoscopic, image dis- 
played in each window, oornes within the viewer's 
binocular fiAional range. In tNs way. easy^vlew, natu- so 
ral-looking images can be presented. 

In the fifth embocfiment, using the output of the win- 
dow, focus c^mnge detection section 135, the camera 
parametei^ ray be changed only for the window speci- 
fied Itjy 'tfie viewer's rnouse operation so that only the ss 
stereoscopic image displayed in the viewer's, attenttpn . 
window is controlled within the binocular fusionsd range. . 
In this way? the ^ operational efficiency of > the present 
invention can be enhanced. > ,u - 

In any of the first to fourth embocEments, the view-^, 4o 
ing di^ance between the viewer arid the display screen . 
may be measured using the viewing distance measur- 
ing means 1 40 shown In the fifth embodiment 

As described so.far, according to the present inven- 
tion, the distance information btfween the camera and 48 
object and the magnitude of parallax of generated ster- 
eoscopic CO images <£splayed on the display device 
are calculated from the display size and the viewirig dis- 
tance, and based on which proper camera parameters 
(focal length or field of view, camera spacing, arxl con- so 
verging poinQ are determined. In this way, easy-to^ew 
stereo600|»c CO images can be obtained automatically. 

The first to fifth embodiments have beeii described 
using binocular stereoscopic images, but this is not 
restrictive. For nrultinocular stereoscopic images alsa if ^ 
the same techniques as described above are appfied to 
determine the camera parameters for aO pairs of images 
presented to the left and right eyes of the viewer, multi- 
nocular stereoscopic CO inreges can be generated eas- 



ily. 

In the first to frfth emtxxftnents, the camera param- 
eters have been determiried so as to bring the stereo- 
scopic CO images within the viewer's binocular fusional 
range for the entire screen generated. However, in the 
case of a scene that forces the viewer to focus his atten- 
tion on a particular ofa|ect on the screen, for example, 
other regions than the attentfon object may be set so 
that binocular fusion cannot be achieved lor such 
regions. In such cases, the CQ operator can easily set 
such regions on the output screen that need not be 
tirought within the viewer's binocular fosional range so 
that data from these regions are not used in determining 
the cannera param^ers. 

In the fir^ to^ fmh enixxiffnents, stereoscopic 
images for the left and right eyes are obtained by CQ. 
but any of the emtKXliments is also applicable for real 
images shot by a stereoscopic camera. In that case, the 
fbcal length f of the plurality of carrmras.;the camera 
spacing Wc, the canftera-ta<x>nverging point distance 
dx Qhe.dstarice from the point of intersection between 
the optic axes of the .canrieras to the centerpoint 
between the plurality of cameras) can be directly used 
as the camera parameters for the actual camera. In this 
case, however, the variable. M in Matherriatical 1 and 
Matheniatical 2 is. not the screen size, but the ratio 
between the size of the light-receiving sur^ce of the 
camera's imaging device and the size of the screen 
where stereoscopic^images are actually disfdayed. 

In the fourth embodiment both the fbcus parameter 
determining section 23 and. the fog effect, parameter 
detOTiining section 24 have: provided, ,but only 
orie or other of the two may be provided. 

In any of the first to fifth ervt>odiments, the camera 
parameters^ have be&i determitied^w as to bring the 
stereoscopic. CQ images within the viewer's binocular 
fusional range.for the entire, screen generated, butlhis! 
is not restrictiva Rather, provisions may be made so. 
that ttie CO operator can set such regions on the output,, 
screen that need not be broMght within the viewer's bin- 
ocular fusional range, arxl so that data from these 
regiprw are not used in detennirting the camera param- 
eters. ' 

In any of the first to fifth embodimerrtSi processing 
sections, such as the distance information extraction 
section and the fusional range verif icat'on section, have 
each been nmplemented using dedicated hardware, but 
instead, the same functions may be implemented in 
software i^ing a computer. 

(Embodiment 6) 

Figure 14 is a diagram showing the conf igi;ration of 
a stereoscopic TV apparatus -according to a sixth 
embodiment of the present invention. In Figure 14, A1 
and A2 are CRTs. A3 and A4 are linear polarizers, A5 is 
a half-silvered min-or, A6 is a pair of glasses formed 
from polarizing filler, A7 is a viewer, A8 is a parallax cal- 
culation section. A9 is a resolution discrimination sec- 
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tbn, A10 is an optimum parallax determining section. 
A11 is a basic synchronization tinning generating sec- 
tion, A12a and A12b are synchronization sections. 
Al3a and A13b are parallax control sections^ Al4a and 
A1 4b are RGB separation sections, A1 5a and A1 5b are 5 
CRT driving sections, and A16 is a viewing distance 
measuring section. 

The operation of the stereoscopic TV apparatus 
having the above configuration will t>e deecrik)ed below. 
First, a right-eye image signal is applied to the resolu- 10 
ton discrimination section A9, the syrx;hronization sec> 
ton Al2a. anti the parallax calculation section A6. 

The resolution discrimination section A9 detects 
the horizontal and vertical frequencies of the input 
Image signal and discriminates the resolution of the 15 
input image. The basic synchronization timing geneiat- 
ing section All generates synchronuation timing data • 
matching the detected horizontal and vertical frequen- 
cies of the input image, and supplies the data to the syn- 
chronization sections Al2a and A12b, which are thus 20 
synchronized to the input image signal and generate 
synchronization timing necessary for subsequent 
processing. 

From the right-eye and left-eye image signals, the 
parallax calculation section A8 calculates depth infer- 25 
maHon (this is defined as a parallax map) at each point 
of the input image. A variety of methods are proposed 
for parallax map calculation. A block nriatc*iing method 
that involves correlation computation will be described 
below. 30 

In Figure 15. consider left-eye and right-eye images 
each of N X M size. In the left-eye image, consider a 
block wirKJow of n x n pixels (3x3 pixels in the f igire]. 
The same vnage as shown in this block window is 
located in the right-eye image by using a window of the ^ 
same size. At this time, the displacement between the 
left and right blocks is represented by a vector (Ax, Ay), 
whose horizontal component Ax irxticates the binocular 
parallax of the left-eye and right-eye images at the 
center coordinates of the block windows. 40 

By horizontally shifting the block window position in 
the reference left-eye image in sequence across the 
entire screen, and by ffindir^ the conresponding block 
position (representing the t)inocular parallax) In the 
right-eye inmge for each shifted block position, a paral- 45 
lax map (showing depthwise distance at each position 
on the screen) can be obtained for the entire screen. 
The displacement between the left-eye and right-eye 
images at coordinates (x. y), that is. the binocular paral- 
lax (Ax. Ay], can be expressed as bo 

[Mathematical 8] 

Ax = i, for Min {Corr (i, j}} 

SB 

where 



[Mathematical 9] 

nxn 

Ckwr 0 . D - £ I GL (XK YIO -G R (Xk-i. Yki-) I 

In Mathematical 9, Z means taking the sum of the abso- 
lute values by varying the coordinates xk. yk within the 
bk>ck window of n x n. QR(xk. yl^ and GL(xk, yk) repre- 
sent luminance values at coordinates (xK yk) in the 
right-eye and left-eye images, respectively. 

In the binocular parallax Ax, Ay, the component that 
directly irxticates the depthwise position is Ax. When the 
value of the t>jnocular parallax is positive, the right-eye 
image is positioned to the right and the left-eye image to 
the left of the reference image, and the object Ges 
behind the depthwise position where fc»nocular parallax 
is 0; on the other hand, when the value of the binocular 
parallax is negative, this means that the object is posi- 
tioned in front of the depthwise position where binocular 
parallax is 0. 

From the parallax map obtained in the at>ove man- 
ner, the parallax calculation section Ad outputs, for 
example, the largest value (the binocular parallax of the 
ferthest object). Instead of simply extracting the maxi- 
mum value of the binocular parallax, spatial low-pass fil- 
tering may be appOed, or a plurality off extraction regions 
may be preset and calculatkKis may be made using a 
statistical technique. 

Next, the optimum parallax deternrining section 
A10 determines the amount of horizontal translation of 
the left-eye and right-eye images so that the viewer of 
the stereoscopic TV can fuse the displayed stereo- 
scopic images. This translation amount is determined 
on the basis of the output of the resolution dscrimina- 
tion section AS (the reeult obtained by judging the inr^e 
resolution and aspect ratk) based on the kind off input 
image signal detected), the image display size (in this 
case. CFTT diagonal size expressed in inches), the out- 
put of the parallax calculation sectnn A8 (the parallax 
map), arxi tfie distance between viewer arxl display sur- 
face measured by the viewing distance measuring sec- 
tion A16. 

The optimum parallax determining sectk)n A10 has 
a datat>ase defining relationships between display 
screen size and viewer's lusional limits, and by refer- 
encing this database, deterrrunes the anrxHjnt of hori- 
zontal translation so that the viewer can achieve 
binocular fusion. 

The method of determining this ¥vill be described in 
further detail. Denoting the largest t>lnocular parallax - 
output from the parallax calculatbn section AS by A 
(dots), the horizontal dot count of the input image signal 
detected by the resolution discrimination section A9 by 
DH, the horizontal length of the dfeplay CRT s A1 and A2 
by L, and the viewer's viewing distance measured by the 
viewing distance measuring section A16 by ds, the larg- 
est parallax Dm on the screen is given by [Mathematical 
10]. 
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[Mathematical 10] 

A.L-Dm 

The left-eye and rioht-eye images are translateGl hori- 
zontalty so that Dm becomes almost equal io the 
viewer's birKXXitar • parallel concDtiori or provides a 
snmller artgle than this. For exampte, to make the maxi- 
mum value o1 the binocular paraDax coincide with the 
viewer's btnocUar parang oondrtion, tiie amount of hor- 
izontal translation, Dc; is given ksy [Mathematical 1 1]. 

[Mathemaficalll] ' 

DcsDm-We 

Here, We is the interpupillary distance of the viewer, 
which, in practice, is.adSusted by shilling the lef^ey^.auid 
right-eye imageis in opfX)site! di^ horizoritally by 
Dc/2. The aniount iof frcprislaib'OT^ Pc rnay be adjusted,- 
as riecessary, based on. the resuft. derived from the 
above equation.. ^. . . ^ 

Furttier. in Mathesnatical^^ 0 . if the smallest binocu- 
lar parallax* (the ^rgest parallax when displaying the 
object in tiie fbregixaind on the screen) is set as 4i.:^®i^ 
the optimum paraDax determining secUon AlO^cleter? 
mines the amount of horizontal translation of thje.screen 
so that Dm becornes siraller^th^^ the viover^s largest 
fusional parallax.(which vailes depending on the screen 
size). . 

Based on the thus obtained amourrt of horizontal 
translation, Dc, the parallax control sections Al 3a and 
A13b move the rightHeye €md left-,eye images, m oppo- 
site directioTO horizpntally by Dc/2. Ihen, the iniage.&ig- 
nals are sepeurated by the ROB separation, eeciipne 
Al4a and A14binto .the R, Q, and B signals, wh^^ 
supplied to the CFTTs A1 and A2 )na ttte CRT driving 
seclioris Ai$a and A1 5b. The images displayed pn the 
CRTs A1 and A2.are iinea/ly polarized by the re^ 
polarizers A3 and A4 prieiTted at right angles, to eacK 
other, and the polarized images are combi^^ by the 
half-silvered,, rnirror AS. By wearing the polarizing 
glasses A6 with th^^^^ polarization ori- 

ented in cSriejCtions corresponding to. the polarizers A3 
and A4, the viewer A7 can view the ieft-eyeimage with 
his left eye. and the right-eye image. with his right eye, 
thus achieving stereoscopic vision. 

As ciescribed atHSve,. according to the present 
embodiment, by discriminating the, kind of input Image 
signal and computing the size of the display screen, the 
viewer can always view natural-looking st^epscppk; 
images displayed with dpitimum binocular parallax. 

(Embodiment 7) . . , 

Figure 1 6 is a diagram showing the configuration of 
a stereoscopic TV apparatus, according to a seventh 
en^odimentof the present invention. In Rgure 16, A1 is 



a CRT. A18 is a pair ofTiquidHaTStal shutter glasses, A7 
is a.viower. A8 is a paraDax cateutation section. A9 is a 
resolution d^crimination section. AID Is an optimum 
parallax determining section. A1 i is a basic synchroni- 
5 zation timing generating section. AiZ is a synchrcmiza- 
tion section. A13 is a parallax control section. A14 is an 
RGB separation section. A15 is a CRT driving section, 
A1 6 is a viewing distance riieasuring section, and Al 7 is 
a Equki-Grystal shutter switdiing pulse generating see- 
to - tion. 

This configuration is an adaptation of the stereo- 
scopic IV apparatus of the sixth emtxxtiment fbr use 
with afieM sequential stereoscopic bmige tigrmi. 

The operation, of the stereoscopic TV apparatus 

IS haying the above configuration will be described below. 
The basic operation is the same as the sixth ^nbodi- 
merit, but since the left-eye and .r^-eye images are 
time-multiple>®d on one stereoscopic image signal and 
are iiput alternately .with eac^ other, as shown in.Figure 

so 17,tfie.jQitqM^ 

lliat .is,, the Inquid-crystal elmitte»', switching pulse 
generating section Al 7 outputs the iiqidd-crystal shutter 
oontiol signal shpwri in Rgure 17. in response to which 
the left-eye shutter in the liquid-crystal shutter glasses 

25 A18 is cpened.to admit light when the right-eye shutter 
is dosed to block Bght, an^^ 

Ifinst, the right-eye image^signaJ is input to the reso- 
lution tdiscrirninatipn sectiorirA9, tfie ^nchronization 
section A12. and the parallax, calculatipn seclSori A8. 

30 The resolution discrimination section A9 detects the 
hortzorrtal and vertical frequencies off the input image 
signal and discriminates the resolution of the input 
image.. Tlie basic syrichronizatiort; timing generatirig 
section Al 1 outputs synchronization fining data match- 
es ing tfie detected horizontal and vertical frequericies of 
the input image, and the syrv^hronization sectipn A12 
syfKhrpruzedtpttie timing o^ . 

rTTie.parallax caicuIatlcn ^eptlon.M^^^ the 
paralto m«y3^q^ right-eye and 

4o left-eye image signals input alternately, by time muK-, 
plexing. The calculation of .the, p»rall^ . map can be 
made in exactly the same manner as in the sixth 
emtwdimerit 

.Then, the parallax calculation section Ad outputs, 

4S for example,' the bjnocUar. parallax of the rriost distant 
object among the binocular paraliaxes phlaineci at the 
respective points of . the image. At thicf time, in calculat- 
ing the binocular parallaxes, spatial low-pass filtering 
may be applied, or a plurality of extraction regions may 

so be preset and calculations may be made using a statis- 
tical techniqua , 

Next. t}ased on the output of the resolution discrirn- . 
ination sectipn AS, the innage display sae, the output of ; 
the parB^iwc calculation isection , A8, : and the distance- 

66 b^een viewer and dj4>l.ay surfiace, the optimum paral- 
lax determining. se<:tion Alb determines the amount of 
horizontal translation of the left-eye and rightreya 
images so that the stereoscopic images displjayed can 
be fused with txTth eyes. 
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The method of determining the translation amount 
is exactly the same as that described in the sixth 
embodiment. That \s, denoting the largest binocular |3ar- 
aliax oulput from the parallax calculation section A8 by 
A (dots), the horizontal dot count of the input image sig- 5 
nal detected by the resolution discrimination section A9 
by DH. the horizontal length of the cEsplay CRT A1 by U 
and the vievver's viewing distance measured by the 
viewing distance measuring section A1 6 by ds, the larg- 
est paraDax Dm on the screen Is given by [Mathematical 10 
1 0]. To make the maximum value of the binocular paral- 
lax coincide with the viewer^ binocular paralel condi- 
tion, the amount of horizontal translation, Dc. is given by 
[Mathematicat 11 1. Howevar, the amount of translation, 
Dc, may be adjusted, as necessary, based on the result 75 
derived from this equation. 

Further, in Mathematical 10, if the smallest binocu- 
lar parallax (the largest parallax when displaying the 
object in the foreground on the saeen) is set as A, then 
the optimivn parallax determining section A10 d^er- zo 
mines the amount of horizontal translation of the screen 
so that Dm becomes smaller than the viewer's largest 
f usional parallax (which varies depencing on the screen 
size). 

Based on the thus obtained amount of horizontal 2s 
translation, Dc. the parallax control section A13 move 
the right-eye and left-eye images in oppoerte directions 
horizontally by Dc/2. At this time, since the left-eye arxl 
right-^ signals are irput as a time-multiplexed stereo- 
scopic image signal, the scre^ display is switched 30 
between tiie left-eye and right-eye images. Tlierefore, 
the amount of horizontal translation of the image is 
switched from h-Dc/2 to -Dc/2 or vice versa between 
fields. 

The image signal is then separated by the RGB 55 
separation section A14 into the R. Q, and B sigrial^ 
¥vhich are supplied to the CRT A1 via One CRT driving 
section A15. The stereoscopic images di^layed on the 
CRT A1, alternating between the left-eye and right-eye 
images, are presented independently to the respective 40 
eyes of the viewer wearing the rmuid-crystal shutter 
glasses Aia 

As described above, acoorcfing to the present 
embodiment, wen when the input Image signal is a 
time-multiplexed stereoscopic image signal, the viewer 45 
can always view natural-looking stereoscopic images 
displayed with optimum binocular parallax. 

(Embodiment 6) 

so 

F^ure 21 Is a diagram showing the configuration of 
a stereoscopic TV apparatus according to an eighth 
embodiment of the present Inverrtioa In Figure 21 , A1 
and A2 are CRTs. A3 and A4 are linear polarizers. A5 is 
a half-silvered mirror, A6 is a pair of glasses formed bb 
from polarizing filter, A7 is a viewer, A8 Is a parallax cal- 
culation section, A9 is a resolution discrimination sec- 
tion, A10 is an optimum parallax determining section, 
A11 is a basic synchronization timing generating sec- 



tion. A12a and A12b are synchronization sections, 
Al3a and Al3b are parallax control sections, Al4a arxi 
A1 4b are RGB separation sectior^ A15b and A\6b are 
CRT driving sections, and A16 is a viewing distance 
measuring section; these sections are the same as 
those used in the sixth emixxitfnent. 

The difference from the sbctii embodiment is the 
addition of the fbflowing sections: a window information 
management section A27, a window irrfbrmation man- 
agement control section A26, a mouse condition detec- 
tion section A25, a window size detection section A22, a 
window generationAdeletion detection section A23, a 
window focus change detection section A24, and a 
mouse A28. 

lYie operation of the stereoscopic TV apparatus 
having the above conf Hjuiation will be described belowi 

In the sixth and seventh entedlments. the image 
display size was the screen size of the display appara- 
tus itself regardless of the synchronization frequency of 
the input video signal. On the other harxl, in the present 
ennbodiment, multiple kirxis of stereoscopic images are 
displayed simultaneously in different windows on a com- 
puter screen in a windowing environment which has 
recently t>ecome a predominant operating environment. 
And parallax Is controlled in response to such condi- 
tions theft viewer changes the size of the window by 
using a mouse. 

It is assumed here that a plurality of windows are 
displayed on the screen of each of the CfYTs A1 and A2 
of Figure 21. arxt that stereoscopic im^es are dis- 
played in one of the windows. 

Usually, the viewer is allowed to resize each win- 
dow as he desires by using the mouse A2d. When tiie 
size of the stereoscopic images changes as a result of 
a change in wirxlow size^ not only the parallax of the cfis- 
played stereoscopic images but the viewer's binocular 
fusional range also changes. Therefore, the window 
size must t>e monitored constantiy, and the parallax 
must always be controlled accordingly. More specifi- 
cally, information about the wirxiow operated by the 
viewer using the mouse is detected by the window infor- 
mation management control section A26. 

The window information nnanagement control sec- 
tion A26 manages the currently displayed wirxlows by 
tiie window generationAJeletion detection section A23, 
and the size of each individual window is detected by 
the window size detection section A22. Data represent- 
ing the size of the applicable window Is oulput to the 
optimum parallax determining section A1 0. 

The optimum parallax deterntining section A10 
obtains ttie horizontal arvl vertical dot counts of the dis- 
play screen and the size of each window (dot count) 
from the outputs of the resolution discrvnination section 
A9 and the window size detection section A22. and 
based on the thus obtained information and on tiie infor- 
mation about the size of the entire image display area 
(CRT diagonal size in inchee}, calculates the size of 
each window actually displayed (in inches, centimeters, 
etc.). 
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The remainder of the process is the same as that 
desabed in the axth ehixxliment That is, from the 
right-eye and left-eye image signals, the paraflax calcu- 
lation section A8 calculates depth information at each 
point of the input image, and outputs a maximum or 5 
minimum value, for examplei 

Next, the optimum parallax determining section 
A1 0 obtains the actuaJ size of the display window from 
the output of the resolution discrimirstion section A9 
(the reaift obtained by judging the image resdutXHi and 
a^ect ratio based on the kind of input image signal 
detected), the entbre image display size Qn this case, 
CRT diagonal size .epcpressed in InchesX and the display 
window size (dot count) output from the windovv infor- 
mation management secfion A27, and deterrnnes ttie 
amount of horizontal translation of the left-eye and right- 
eye images so that the viewer of the stereoscopic TV 
can fuse Ihe displayed stereoscopic images. TTtis trans- 
latk)n amount is detennined, try using Mathematical 10 
and Mathmatical 1 1. on the basis of the output of the 
paiaOax calculation section A8 (the paraDax map) and 
the distance between viewer and display surface meas* 
ured by the viewing distance nrieasuring. section A16.. 

Based on the thus obtained amount of horizontal 
translation, the parallax control section. A1 a and Al3b 
move the right-eye and left-eye images in opposite 
direcGons horlzontaHy so that the displayed images will 
come within the viewer's binocular fusional range. Then, 
the image sgnals are separated by the RQB separalton 
sections Al4a and A14b. into the R. O, and B signals, 
whitfi are passed through the window information man- 
agement control section A26 and are output to the 
CRTs A1 and A2, via the CRT driving sections A15a 
and A15b^ for dispiay in the designated window on the 
display screen. 

When proce^ing the input image signals fbr dis- 
play in a ptural'rty of windows of different sizes, the 
amount of horizontal translation described above 
should be calculated independ^niy for each^ window. 
Further, when there are.diftarent image sigr»ls for dis- 
play in different windows of respectivi^y determined 
sizes, the processing should also be performed inde- 
pendently for each window. . 

When the viewer has changed the size of a window 
by using the mouse A28, the window size detection sec- 
tion A22 detects a change In the window size, upon 
which the optimum parallax determining section A10 
calculates the amount of horizontal translation of the 
left-eye and r^gh^eye images, and the result is Immedi- 
ately reflected on the display saeen. 

When displaying a plurality of stereoscopic images 
in a plurality of windows, provisions n^ be made so 
that the window specif led by the user using the mouse 
is detected as the viewer^ attention window by using 
the window focus change detection section A24, and 
the camera parameters are changed only fbr that win- 
dow, thus controlling only the stereoscopic image dis- 
played in the viewer^s attention window within the 
binocular fusional range. In this way, the operational eff i- 



dency of the present invarrtion can be enhanced. 

As described above, in a dtsp^y system having a 
windowing environment where there occur changes in 
wiridow size, the stereoscopic inr^ges displayed in each 
indvidual window can be controiled within the viewer's 
binocular fusloral range \yy rnqriltoring the window size 
using the window information management section 
A27. 

In the sixth, seventh, and eighth embodiments, the 
viewing distarice was meaajred using the viewing. dis- 
tance measuring section A1 6. but alt^natiyely, a fis^ 
value may t>e used, such as a recommended viewing 
distarice obtained from the CFTT siza 

In the.sixth. seventh, and eighth embodiments, the 
viewing distance meast^ing section A16 may be con- 
structed to measure the yieyvirig distances for a plurality 
of viewers and to output the average or weighted ayer^. 
age of the measured values or the n^mum or nriini- 
ntum value thereof, thus performing ■ parallax control 
considering the viewing distances of aJI the vtewere 
Involved. Further, in an erivironnrient where a plurality of 
viewvers are yiewlrig differ^ windows, if binoculcur- par- 
allax Is (^ntrolted by irdependeritly setting a viewing 
distance, for . eac^ window, optjinum stereoscopic 
images can be presertted to eacfi individuai.yiewer. ^ 

An the sixth, seventh, arvl eighth embodiments, ttie 
optinrujm parallax determining section Ai 6 calculated 
the largest parallax Dm on the screen by using the out- 
put of the parallax calculation section A8, the output of 
the resolution dtecrimination section A9. the horizontal 
length L of the display CRTs A1 and A2, and the 
viewer's viewing distance ds measured by the viewing 
distance measuring section A16. Depending on the kind 
of input image, signal, however, the produqed display 
may not use the entire area of the CRT screen. To 
address this, the resolution disalmination section A9 
may be provided vyith a database defining relationships 
between,the Mnd.oT Input Image ^nal (HDTV. NTSC. 
EDiy,.conputer*;generated vraige^, etc.] and display 
screen size, and may be constructed to be able to cor- 
rectly recognize the magnitude of displayed binocular 
parallax according to the kind of input irnage signal. 

In the sixth, seventh, and eighth embodiments, the 
parallax calculation section A6 was described as out- 
putting the maximum value of the binocular parallax, but 
instead, the miriimum value may be used so that the 
parallax of tfie nearest object appearing fkxiting above 
the saeen can be brought within the viewer S binocular 
fusk>nal range. In this case^ howevjar, since the magni- 
tude of the allowable binocular paraDax changes as a 
function of the viewing distance and screen size, a data- 
base denning the values of allowable bonocular paral- 
laxes nriust be provided, , . ^. 

The sixth, seventh, and eighth embodiments have 
been described.as using multisync rnonitors, but in the 
case of a. monitor specif toally designed for use with a 
fixed frequ^cy image signal, the resolution discrimina- 
tion section need not be provided, and a f ixed value may 
be used in the product specification. - . 
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Further, typical screen sizes, such as 1/2 or 1/3 of 
the full screen size, may be predefined by fixed values. 

In the sixth, seventh, and eighth entxxjiments, the 
parallax control section A13 may be constructed to 
operate wtienever the amount of translation. Dc. is cat- s 
culated, or to operate only at the start of the apparatus 
operation and when there occurs a significant change in 
the binocular parallax of the input image. 

In the sixth, seventh, and eighth embodiments, pro- 
visions may be made so that the viewer enters adiust- io 
merit comnnands using pushbutton switches or a remote 
controller only when he desires to adtjust binocular par- 
allax. 

In the seventh embodiment, a trne multiplexing 
system requiring the use of nquid-crystal shutters was is 
used to produce a final stereoscopic Image display, but 
it will be recognized that any other stereoscopic display 
mtfhod may be used, cuch as a parallax k>arrter method 
and a lenticular-lens method that does not require 
glasses. 20 

As is apparent from the descriptions so far ^ven, 
since stereoscopic images are generated, or left-eye 
and right-eye images are autc^natitslly moved horizon- 
tally prior to image presentation, by considering the dis- 
play screen size of the stereoscopic TV apparatus, the 25 
resolution (frequency) of the input image signal, arxi the 
window size, the present invention has the advantage off 
being able to generate and preserrt stereoscopic 
images looking natural and easy to view for the viewer. 

so 

Claims 



a camera parameter determining section for a 
CG operator to determine said camera param- 
eters from an output of said camera parameter 
calculating means; 

whereby said projection transformation section 
generates said plurality of two-dimensional 
projection Images by using said determined 
camera parameters. 

2. A st^eoscopic CO image generating apparatus 
according to daim 1, wherein said distance infor- 
mation extraction section extracts from said three- 
dimensional structural information the longest dis- 
tance or shortest distance between said cameras 
and said otsject. 

3. A stereoscopic CO image generating apparatus 
according to daim 2, wherein said longest distance 
or shortest dtetance between said cameras and 
said object can be manually set by said CO opera- 
tor as he desires 

4. A stereoscopic CO image generating apparatus 
according to claim 2, wherein 

^id CG operator designates a specific 
region on a CG display screen, and 

from the three-dimensional structural infor- 
mation within said specific region, said distance 
information extraction section extracts the longest 
distance or shortest distance between said cam- 
eras and said object 



1. A stereoscopic CG image generating apparatus 
comprising: 

35 

a projection transformation section fbr, based 
on thre^imensional structural information 
describing a 1hre&<jimensior»l shape of an 
object generating a plurality of twa<imen> 
sional projection images as viewed from a plu- 40 
raity of cameras; 

a distance information extraction section fbr 
generating a dtetance betwireen said object and 
said cameras; 

fusional range computing means for computing 45 
a binooilar fusional range of a viewer viewing a 
screen of a stereoscopic image display device 
fbr dlspiayir^ a stereoscopic image of said 
object on the basis of pre-entered parameters 
consisting at least of the size of said screen so 
arxJ a viewing distance between said screen 
arxi said viewer; 

camera parameter calculating means fbr calcu- 
lating conditions for parameters of said cam- 
eras, based on said binocular fusional range ss 
and on the output of said distance information 
extraction section, so that said object in its 
entirety can be brought within the birxx^ular 
fusional range off said viewer; and 



5. A stereoscopic CG Image generating apparatus 
comprising: 

a projection transformation section for. based 
on three^imensional structijral information 
describing a three-dimensional shape of an 
object, generating a plurality of two-dimen- 
sional projection images as viewed from a plu- 
rality of cameras; 

a rerxierlng section for generating a CO image 
from the output of said projection transfbrma- 
tion section; 

a parallax map calculation section fbr generat- 
ing a distance image off an output image from 
the output of said projection transformation 
section or said rerxiering section and from said 
three-dimensional structural information ; 
fusional range computir>g means for computing 
a binocular fusional range of a viewer viewing a 
screen of a stereoscopic image display device 
for displaying a stereoscopic image of said 
object, on the basis of pre-entered parameters 
consisting at least off the size of said screen 
and a viewing cfstance between said screen 
and said viewer; 

pbcel count calculating means for calculating, 
based on said binocular fusional range and on 
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the output of said pamBax map. calculating 
means, the number of pixels or the number of 
vertices of poty^ons or the number of center- 
points of polygons in the stereoscopic image 
lying within the binocular fu^aonal range of said 5 
viewenand 

a camera parameter determining section for 
d^ermining camera paramet^ by using the 
output of said pn^ coimt x^Iculating means, so 
that a region in the . output Image iri whic^ said 10 
viewer. can adiieve binocular fusiori bepornee 
lai^^ in area thfffi a pre^ 
wtieret^ said prc^ectipn transfprrnaton section 
generates said pliiraJtty of two-tiEmensional 
projection images by using said deternr^ed is 
camera paranieters. .. 

6. A stereoscopic CO image generating; apparatus 
according to claim 5. wherein 

. , a CO operator.de^jg^es a specific region so 
onacJBspiayeaciieen, and \: , 

«ud pxet.ooum,jCalaiIattng means calcu- 
lates- the. nurnber of pi)ceIS:in.a CG image lying 
within the binocular fusionai range of said viewer, 
on.tfie basis of parallax Information within said spe- 2s 
cific regpon, the screen size of said stereoscopic 
image ;dSH6playVdWic^^ viewing, distance 

between said screen and said viewer. 

7. A stereoscopic; CO image generating apparatus so 
according to daim 6, wherein - .1 

said pixel count calculating means detects a 
region of a subject in which said viewer can achieve 
Innocular fusion, and < 

a spedfic image processing section^ is ss 
included fdr applying specific irhage processing to 
Image portions outside the^ binocular, fusible, region . . 
(tetected by saidpiioel count calculatirig rneans. 

B. A stereoscopic CO irnage generating , apparatus 40 
according to daim 7, wherein said specific image 
processing section indudes a clipping value deter- . 
mining section for detenmining the locati^^^ 
ping^ plane so that CO Irm^ges lying, in- portions 
outside said biriocular fusible re^on will not be gen- as 
erated. . 

9. A Stereoscopic CO image generating apparatus 
according to daim 7, wherein said specific image 
processing section jndudes a rendering section for so 
gradually changing an image contrast or transpar- 
ency of the subject over an area extending from a 
neighborhood of a binpculeff fusiorial limit of said 
viewer into a region where thetn'nocular fusion can- 
not be achieved. 65 

10- A stereoscopic CO image generating apparatus 
according to daim 7, wherein said specific image 
procesdng secton includes a fog effect parameter • 



detemfiirting section for controlling the degree of a 
fog effect in such a rnanner as to increase the fog 
effect as a binocular fusionai limit (rf said viewer is 
exceeded. 

11. A stereoscopic CO image generating apparatus 
according to daim 7, wherein said specific image 
processing section indudes a fpcus param^er 
detenrrtning section for cpntTOlIing the degree of a 
defocusfng eff^ in such a manner as to increase 
the defocusing effect as a binocular fusionai limit of 
said viewer is exceeded. 

1Z For use in an win(toMng erivironn>erit where, one or 
more sterecBCopic pp Images are displayed simul- 
taneously; a stereoscopic CO inriage . generating 
apparati© conprising: . f ^ . 

a prpjeciton trarisformalio t>ased 
OH: threerdimenslonal structural information 
de»6cri|bing a ithreeKfimensional diape of an 
object, gjerieratirig a. plurality ofi two-dimen- 
. /sipnal projection imagjss as viewed frorn'a plu- 
- rality of cameras: ^ ^ . ; ^ . 

a distarKe infprmatiori exbiactipn section for 
generating a distarice between said oi>ject and 
eaid camjeras; • 

a window inftyni a tion.manta section for 
detecting, the size .of - each incfividual- window 
where a-stereoscop^c image is displayed and 
information about. a. video, ri^lutipn or syn- 
chronization frequency of, a <^!ay screen; 
a fusionai range vertftcation section for <»lcu- 
lafing from the output of said window irrforma- 
tion management section the size of a window 
on a stereoscopic :irnage cisplay device in 
. which theitwp-dimensional projection images 
of. said object are.displayed asimaln Innages, 
and for calculating,' from the size of eaid win- 
dow,, the output of ;raid,,distance inforrr^ 
extraction section, and^a vising distance of a 
. . viewer, camera parameters for^each individual 
window in order to bring the stereoscopic CO 
images within a birxx:ular fusionai. range of said 
• viewer; and: 
a camera parameter determinirig sedion for. by 
using the output of said.iusiona! range verifica- 
tion section, determining camera parameters 
for stereosa>pic images to be displayed In each 
individual window; 

whereby said projection transformation section 
generates said plurality of two<limensional 
projection .images by using said determined 
camera parameters. 

ia A stereoscopic CO image generating apparatus 
according to claim 1 2 .wherein 

said camera parameter determiing section 
changes iOnly vvhen the viewer polrits such window 
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to be acQustdd , only camera parameters of the ster- 
eoscopic images oorre^oncfing to said pointed 
widow. 

14. A stereoscopic TV apparatus oompri^ng: s 

a parallax calculation section for calcu- 
lating birxKUlar parallax from left-eye and right- 
eye images, and lor calculating a maxffnum or 
minimum value of said binocular parallax; io 
a viewing distance measuring section for 
measuring a viewing distance of a viewer; 
a resolution di^iminatlon section tor discrimi- 
nating the Idrxl of an input image signal by 
detecting a synchronization frequency of said is 
input image signal; 

an optimum parallax determining secbon Ibr 
calculating the magnitude of binocular parallax 
of a displayed image from the output of ^d 
parallax calculation section, the ou^ut of said so 
viewing distance measuring section, the output 
of said resolution discrimination section, arxi 
the size of a display screen, and for computing 
an amount of parallax change necessary to 
bring said binocular parallax within a t>lnocular ss 
fusional range of said viewer; and 
a parallax control section for, in accordance 
with the output of said optimum parallax d^er- 
mining section, translating the left-eye and 
right-eye images in horizontal directions so that so 
stereoscopic images will be displayed within 
the binocular fusional range of said viewer 
even if the synchronization frequency of the 
inpnjt image frequency changes. 

35 

15. In a system for Simultaneously displaying a plurality 
of stereoscopic images in a windowing environ- 
ment, a stereoscopic TV apparatus comprising: 

a resolution discrimination section for discrimi- 
naiing the land of an input image signal by 
detecting a synchronization frequency of said 
input image ^gnal; 

a window intonmation management section for 
detecting the eize of each individual window 45 
where a stereoscopic image is displayed; 
a viewing distance measuring section for 
measuring a viewing distance of a viewer; 
a paralax calculation section fbr calculating 
binocular parallax from left-eye and rIght-eye so 
images, and for calculating a maximum or mirv 
imum value of said bviocular parallax; 
an optimum parallax determining section for 
calculating the actual size of each individual 
window from the output of said resolution die- 65 
crirrrination section, the output of said window 
information management section, and the size 
of a display screen, calculating the magnitude 
of binocular parallax of an image calculated 



from the size of said wirxiow, the output of said 
parallax calculation section, arxl the output of 
said viewing distance measuring section, arxi 
for computing an cunount of parallax change 
necessary to bring said binocular parallax 
within a binocular fusional range of said viewer; 
and 

a parallax control section for, in accordance 
with the output of said optimum parallax deter- 
vninlnQ section, translating the left-eye and 
right-eye images in horizontal directions so that 
the stereoscopic image displayed in each indi- 
vidual window wi be brought within the binoc- 
ular fusional range of said viewer e^en if the 
size of each incfvidual window or the synchro- 
nization frequency of the irput image fre- 
quency changes due to an operation by said 
viewer. 

1 6. A stereoscopic TV apparatus according to daim 14 
or 15, urherein said viewing distance measuring 
section outputs as said viewing distance a recom- 
mended viewing distance for a stereoscopic TV. 

1 7. A stereoscopic TV apparatus according to claim 14 
or 15 , wherein said viewing distance measuring 
section measures vieuving distances of a plurality of 
viewers, and outputs as said viewing distance an 
average value or weighted average value of said 
measured viewing distances or a maximum or min- 
imum value thereof. 

1 8. A stereoscopic TV apparatus according to daim 14 
or 15, wherein said parallax calculation section out- 
puts parallax as a predetermined fixed value. 

19. A stereoscopic TV apparatus according to claim 14 
or 15, wherein the output of said resolution discrim- 
ination section is set as a fixed value by assuming 
that only one kind of image is input 

2a A stereoscopic TV apparatus according to daim 14 
or 15, wherein said resolution discrimination sec- 
tion detects tiie kind of said input Image signal 
amaig HDTV, EDTV and NTSC signals and com- 
puter-generated image signals of various resolu- 
tions, and identifies the resolution arxl aspect ratio 
of the detected kind of input image signal so that 
said optimum parallax determining section can rec- 
ogntee an Image sbe which Is viewed by an opera- 
tor , on the display screen. 

21 . A stereoscopic TV apparatus according to claim 14 
or 15. wherein said parallax control section trans- 
lates the images in horizontal directions only when 
tiiere occurs a significant change in the binocular 
parallax of tiie dteplayed imagea 

22. A stereoscopic TV apparatus according to daim 14 
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or 15b wherein sati parallax control section trans- 
lates the images in horizontal directions only when 
said viewer desires to adji^ the birKicular parallax 
and inputs an instruction using an ir^truction 
means such as a pudtbutton switch or a remote 
controller. 

23. A stereoscopic TV apparatus according ip daim 1 5, 
wherein said parallax control section translates the 
1^.^ and right-eye images in horizontal direc- 
tions only for a window designated t>y said viewer 
as a window for which said viewer desires to adjust 
binocular parallax. 
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